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DETAILED ACTION 
Drawings 

The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the first and second 
subset of the stream of images recited in claims 24-26 must be shown or the feature(s) 
canceled from the claim(s). No new matter should be entered. 

Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in 
reply to the Office action to avoid abandonment of the application. Any amended 
replacement drawing sheet should include all of the figures appearing on the immediate 
prior version of the sheet, even if only one figure is being amended. The figure or figure 
number of an amended drawing should not be labeled as "amended." If a drawing figure 
is to be canceled, the appropriate figure must be removed from the replacement sheet, 
and where necessary, the remaining figures must be renumbered and appropriate 
changes made to the brief description of the several views of the drawings for 
consistency. Additional replacement sheets may be necessary to show the renumbering 
of the remaining figures. Each drawing sheet submitted after the filing date of an 
application must be labeled in the top margin as either "Replacement Sheet" or "New 
Sheet" pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, 
the applicant will be notified and informed of any required corrective action in the next 
Office action. The objection to the drawings will not be held in abeyance. 



Application/Control Number: 10/802,043 Page 3 

Art Unit: 2425 

Response to Arguments 

Applicant's arguments filed 24 October 2008 have been fully considered but they 

are not persuasive. With respect to claims 1 and 10, Applicant alleges that: 

To the extent that Official Notice is being taken that it was known in the art to 
transmit metadata that is made up of dynamically changing aspect ratio 
conversion information, Applicants traverse this Official Notice... It is 
respectfully suggested that before the priority date of this Application, the 
transmission of metadata that is made up of dynamically changing aspect 
ratio conversion information was not capable of instant and unquestionable 
demonstration as being well-known. (Remarks, pg. 9-10) 

Examiner respectfully suggests that Applicant has mischaracterized the rejection 

based on Official Notice set forth in the previous Office Action. The use of Official 

Notice in the previous Office Action was merely intended to teach "that it is well known 

in the art to transmit a video program and associated metadata over a communications 

network to a plurality of devices" (Office Action, pg. 4) and not to teach that said 

metadata is "made up of dynamically changing aspect ratio conversion information," as 

alleged by Applicant. Masukura teaches a system for processing a video program and 

associated metadata on a frame-by-frame basis in which the metadata changes 

"temporally" to reflect changes in the conversion information. Masukura further teaches 

that the video program and metadata may be transmitted to a remotely located output 

device "by way of a network or broadcast waves" [0029]. Examiner maintains that 

broadcasting the video program of Masukura would inherently comprise temporally or 

dynamically changing metadata in a manner cumulative with the method of claim 1 and 

the use of Official Notice was merely intended to teach the well-known ability to transmit 
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a video program and associated metadata to a plurality of devices, a combination of 
known elements that would have yielded predictable results. 

In compliance with the requirement of MPEP §21 44.03(C) that "the examiner 
provide documentary evidence in the next Office action if the rejection is to be 
maintained," Examiner submits that Swart et al. (Pub. No.: US 2003/0025832), as cited 
in the Office Action dated 10/19/2007, teaches the transmission of a video program and 
associated metadata to a plurality of output devices. 

As agreed upon in the interview conducted on 10 September 2008, previously- 
withdrawn claims 24-26 have been rejoined. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-14, 20, 21, and 23-26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Masukura et al. (Pub. No.: US 2004/0148640) and further in view 
of Yamauchi et al. (US Pat. No.: 5,907,659) and Official Notice. 

As to claims 1, 2, 10, and 24-26 Masukura teaches a system and associated 
method for processing a video program on a frame-by-frame basis in which the 
metadata changes temporally to reflect changes in the conversion information. 
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Masukura further teaches that the video program and metadata may be transmitted to a 
remotely located output device "by way of a network or broadcast waves" [0029]. 
Masukura et al. teaches a method for processing a video image in which the processing 
instructions conversion information are encoded in metadata associated with the 
content and that said metadata includes aspect ratio conversion information [0071]. As 
to the limitation that the metadata "dynamically changes," paragraphs 0053-54 of 
Masukura teach that "...the processing is basically carried out frame-by-frame... the 
metadata may be read as needed during processing. " Further, Fig. 3 and 5 teach that 
the metadata associated with each frame or temporal region may specify different 
conversion or processing information. 

Though paragraph 0071 of Masukura teaches that the "restriction information 
about the relative frame is acquired (step S71) from the metadata .. .The restriction 
information includes the number of pixels and the aspect ratio of an apparatus that uses 
the output moving pictures, " it does not explicitly teach converting from a first aspect 
ratio to a second aspect ratio. In an analogous art, Yamauchi teaches steps for 
converting a display from a first aspect ratio to a second aspect ratio. Fig. 1 A-2B of 
Yamauchi teach converting from a first aspect ratio to a second aspect ratio. Further, 
Fig. 13A-C and 27A-D of Yamuchi teach that the conversion information can change 
from frame-to-frame to accommodate subtitle placement. As Yamauchi teaches 
methods for performing aspect ratio conversion, the combination of the conversion and 
processing information taught by Masukura with the aspect ratio conversion taught by 
Yamauchi would have been obvious to one of ordinary skill in the art at the time of the 
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invention since such combination would have yielded results that would have been 
predictable to one of ordinary skill in the art at the time of the invention. 

As to the limitation that the video program be transmitted to a geographically 
different location, Masukura teaches, "...the output moving picture storage unit 106 may 
exist in a remote place by way of a network or broadcast waves" [0033]. Furthermore, 
Examiner takes Official Notice that it was well known in the art of video distribution at 
the time the invention was made to transmit a video program and associated metadata 
over a communications network to a plurality of devices. Examiner maintains that 
where the conversion information of Masukura changes during the program, as 
analyzed above that broadcasting the video program of Masukura would inherently 
comprise temporally or dynamically changing metadata in a manner cumulative with the 
method of claims 1 and 2. 

As to the distribution system recited in claim 10, Masukura teaches that the both 
the input and output moving-picture and metadata storage units may exist "in a remote 
place by way of a network or broadcast waves" [0029, 0033]. As to the recited 
distribution point, Masukura teaches that "...a video camera or a broadcast wave tuner 
may be used as the input moving-picture storage unit" [0027] which is equivalent to the 
recited distribution point. Examiner maintains that broadcasting the video program of 
Masukura would inherently comprise temporally or dynamically changing metadata in a 
manner cumulative with the system of claim 10. 

As to the limitations recited in claims 24 and 25 regarding a first and second 
subset of the stream of images, the temporal regions taught by Masukura are equivalent 
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to the recited subsets. Fig. 5 teaches that the metadata may contain different 
conversion or manipulation data for each temporal region. 

As to claim 3, Masukura teaches that the metadata can be adapted to adjust for 
the aspect ratios of various display devices [0071] which is consistent with the recited 
"plurality of recited target aspect ratios." 

As to claim 4, Fig. 1B-2B of Yamauchi teaches the recited shrinking. 

As to claims 5 and 23, paragraph 0071 of Masukura teaches: 

restriction information about the relative frame is acquired (step S71) from the 
metadata. The restriction information is information to limit the position of the cutout 
region. The restriction information includes the number of pixels and the aspect ratio of 
an apparatus that uses the output moving pictures. 

Using the restriction information to limit the position of a cutout region is 
equivalent to the limitation recited in claim 5 that "the video conversion information 
specifies a portion of the video program to display as the second aspect ratio." 

As to claim 6, Fig. 4-8 of Masukura teach that different areas of the image can be 
scaled differently as recited; further, Masukura teaches that the height or width of the 
image may be scaled differently to accommodate the aspect ratio of the display device 
[0082]. 

As to claims 7, 8, and 21 , the recited "rotating or mirroring" and "plurality of 
discreet portions" is taught by Fig. 4 and 6 of Masukura as applied to claim 6. The 
shaded areas of Fig .4 and 6 are equivalent to the recited "plurality of discreet portions," 
and their manipulation (movement, rotation, etc.) evident in the difference between the 
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two figures is equivalent to the recited "rotating or mirroring" and "different 
transformations for different portions." 

As to claim 9, the recited computer-readable medium and computer-executable 
instructions are inherent in a system capable of receiving and processing digital video, 
such as that taught by Masukura. 

As to claim 1 1 , Fig .1 of Masukura teaches an output video display coupled to a 
processed video generator. 

As to claims 12 and 13, paragraphs 0053-54 of Masukura (cited above) teach 
that the processing information is read from the metadata on a frame-by-frame basis, or 
as needed by the video processor; it is inherent that this would allow the video 
processor to change conversion to a third aspect ratio mid-stream if such change were 
indicated by the metadata. 

As to claim 14, Fig. 4 and 6 of Masukura teach the recited "first and second 
cutout" and Fig. 1 teaches that the cutout-processing instructions are contained within 
the metadata. 

As to claim 20, Yamauchi teaches a method which includes converting a video 
image from a first aspect ratio to a second aspect ratio. In Fig. 1 B, an image originally 
in a 16:9 aspect ratio is converted into a 4:3 aspect ratio. The dashed lines overlaid on 
the 16:9 image in Fig. 1 would be the equivalent of aperture 1012 shown in Fig. 10 of 
the instant application. Fig. 1 B of Yamauchi further teaches that only the portion of the 
16:9 image corresponding with the overlay is displayed in the converted 4:3 image. 
Conversely, Fig. 1C of Yamauchi teaches a method for converting from an original 4:3 
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aspect ratio to a 16:9 aspect ratio. Further, the shaded areas of Fig .4 and 6 of 
Masukura would be equivalent to the recited apertures or cutouts and movement and 
teach the recited "manipulations," as analyzed w/r/t claims 7 and 8. 

Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Masukura and Yamauchi as applied to claims 1 and 10 above, and further in view 
of Duffield et al. (US Pat. No.: 5,461,427, previously cited). 

As analyzed above, Yamauchi in view of Masukura teaches the method of claim 
1 including the use of metadata to facilitate conversion from a first aspect ratio to a 
second aspect ratio, but does not explicitly teach the use of one or more video streams 
of the program. Duffield teaches that the same program may be simultaneously 
broadcast (simulcast) in both NTSC and HDTV standards so to accommodate viewers 
with NTSC-compatible televisions as well as users with HDTV sets. Duffield teaches 
that such simulcasting is necessary to service users of both standards because, "the 
HDTV system uses a 16:9 aspect ratio while the NTSC system has a 4:3 aspect ratio, 
the HDTV system will have 1 125 television scan lines while the NTSC system has only 
525" (Col. 1 ). Duffield further teaches a receiver which can receive and process both 
NTSC and HDTV signals and, "includes a controller responsive to user input for 
associating a single label with a pair of television channels, one being an NTSC-signal 
carrying channel, and the other being an HDTV-signal carrying channel" (Col. 2). Figs. 
2a and 2b of Duffield show the same program displayed in both the 16:9 and 4:3 aspect 
ratios, respectively. As simulcasting the same video program in multiple formats to 
accommodate viewers with different display types was known in the art of video 
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distribution, it would have been obvious to one of ordinary skill at the time of the 
invention to stream or broadcast the same program in multiple aspect ratios or display 
formats to allow users with different display capabilities to enjoy the same program. 
Since Duffield's disclosure was published in 1995, it does not explicitly refer to 
embodying video programs in a "content stream," but transmitting a video program in a 
content stream is an application of existing technologies that would have been obvious 
to one of ordinary skill in the art at the time of the invention. 

Contact 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan Stronczer whose telephone number is (571) 270- 
3756. The examiner can normally be reached on 7:30 AM - 5:00 PM (EDT), Monday- 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Brian T. Pendleton can be reached on (571) 272-7527. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Examiner, Art Unit 2425 
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Primary Examiner, Art Unit 2421 



